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1 Introduction 

Many stochastic systems can be described by the abstract mathematical model in 
the Banach space jB(M'^) of functions ip{u),u € M'^, called random evolution model, 
introduced by Griego and Hersh [H [21 [3] . 

Asymptotic methods in the theory of random evolutions were applied by many 
mathematicians (see, e.g. [H [TDl HSj)- Application of these methods to different 
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stochastic systems may be found in [13]. In [T7] kinetic theory of gases, isotropic 
transport on manifolds, stabihty of random oscillators were studied by similar meth- 
ods. 

Among recent works in this area with applications in mathematical biology we 
may remind results of Hillen and Othmer [H [H] (see also [15] ) . 

Namely, transport equations are used in mathematical biology to model movement 
and growth of populations. Certain bacteria show the following movement pattern: 
periods of strait runs alternate with periods of random rotations which leads to 
reorientation of the cells. We may model this movement by a velocity jump process, 
which leads to a transport equation. 

Thus, the linear transport equation 

d f 

—p{x,v,t)+vS/p{x,v,t) = —Xp{x,v,t)+ / XT{v,v')p{x,v' ,t)dv' 

V 

in which p{x, v, t) represents the density of particles at spatial position x G i?" moving 
with velocity v <Z BP" at time t > arises. The turning rate A may be space- or 
velocity-dependent. The turning kernel or turn angle distribution T{v,v') gives the 
probability of a velocity jump from v' to if a jump occurs. 

The evolutionary equation studied in our work generalizes the transport equation 
described above. Analogical generalization of telegraph-type equation is described in 

m- 

One more example of application of asymptotic methods is described in the works 
of Yin and Zhang [23] . 

They study a model for production planning of a failure-prone manufacturing sys- 
tem, which consists of machines whose production capacity is modeled by a Markov 
or semi-Markov chain. In a large-scale system various components may change at 
different rates. Thus, the system may be decomposed and the states of the chain 
may be aggregated. The introduction of a small parameter e > makes the system 
belong to the category of two-time-scale systems. 

The system is described by the equations of the type 

Here p^{t) is the probability distribution of Markov or semi-Markov chain, Q{t) is the 
corresponding generator. As a rule, the fast changing process in the physical or 
manufacturing systems is hard to analyze. But using limit properties, obtained with 
the help of asymptotic expansions, they replace the process by its "average" in the 
system under consideration. 

The problems of minimization of discounted cost function and optimal control 
are studied in [23] with the use of asymptotic approximations. Markov decision 
problems, stochastic control of dynamical systems, numerical methods for control 
and optimization are also analyzed. 

We study the following generalization of the stochastic systems described above. 

A semi-Markov random evolution (SMRE) is created by a solution of the evolu- 
tionary equation in Euclidean space M'^jd > 1 

du^{t)/dt = v{u''{t);cs{t/e)),t > 
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with € M'^, V a given continuous function from x E into M, {E, 8) a standard 

(polish) space. « is a given semi-Markov switching process se{t),t > on {E,£) 
given in terms of the semi-Markov kernel [6] 

Q{x,B,t) = P{x,B)F^{t),x £ E,B e£,t>0 

that defines the transition probabilities of a Markov renewal process {sen,Tn,n > 0): 

Q{x,B,t) = P{sen+i G B,en+i < t\sen = x} = 

= P{8e„+i G B\cen = x}P{9n+i < t\cen = x}, 

with 9n := T„+i - T„. 
The stochastic kernel 

P{x, B) = P{sin+i G B\cen = x] 

defines the transition probabilities of the embedded Markov chain cSn = ae(T„), n > 0; 
the renewal moments are determined by the distribution function of the sojourn 
times: 

F^{t) = P{en+i < t|as„ = x} =: P{9^ <t},xe E. 

We assume that the distribution functions F^ {t),x G E satisfy the Cramer con- 
dition uniformly on x G -E: 

oo 

sup / e^^F^{dt) <H<oo, (1) 



for all h> 0. 

We denote by Q the generator of the associated Markov process ee^{t),t > given 

by: 

Q = qix)iP-I), (2) 
where the operator of transition probabilities P is defined by 

Pf{x)= J P{x,dy)f{y),xeE, (3) 
E 

for all bounded measurable real valued / defined on E. q{x) is defined by 

q{x) := l/mi(x), 

with mk{x) = s^Fx{ds). 

We will see later that the equation for the regular part of a random evolution 
is defined by the generator (2) of a uniformly ergodic associated Markov process 
seP{t),t > 0. The Banach space B{E) is splitted as direct sum of the two subspaces 

B{E) = Nq^Rq, 
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where Nq := {if : Qip = 0} is the null-space of Q, and Rq := {ip : Qip = ^} is the 
range of Q. 

We define the projector H : iVg := IiB{E),RQ := {I -U)B{E);Uip{x) := (pl,(p:= 
(p{x)7T{dx), where the stationary distribution Tr{B),B £ £ oi the semi-Markov 
process se{t),t > satisfies the relations [8l [T2] 

Tr{dx) = p{dx)mi{x) /m, 
fh := mi{x)p{dx). 



E 



p{B),B G £' is by assumption the stationary distribution of the embedded Markov 
chain sen, n >0, given by the formula 



p{B)= J P{x,B)p{dx),p{E) = l. 

E 



Let us consider the Banach space BiW^) of real- valued test-functions (p{u),u G 
which are bounded with all their derivatives. We equip B(U.'^) with sup-norm 



\ip\ \ := sup \^{u)\ < C( 



for some > 0. 

The random evolution in B(M.'^) is given by the relation 

^t:=^{u%t)),^GB{R''). (4) 

In the present paper we shall investigate the asymptotic behavior of SMRE (4) 
as e ^ under the assumption of uniformly ergodicity of the semi-Markov switching 
process as(t) described above and under the assumption of the existence of a global 
solution of the deterministic equations 

dux{t)/dt = v{ux{t); x), X £ E. (5) 

Let us first consider the deterministic evolution 

^x{t,u) = ip{ux{t)),ux{0) = u e M'^. 

It generates a corresponding semigroup on B{M.'^) : 

Yt{x)ip{u) := ip{ux{t)),Ux{0) = u, 

and its generator has the form: 

d 

W{xMu)=v{u;x)v'{u) :=J2Mu-^^)v'kiu),v{u) G C°°(M'^). (6) 

k=l 

Under the assumptions of [10] by the average principle the weak convergence 

u^t) ^u{t),e ^ (7) 
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takes place. The average limit evolution u{t),t > is defined by a solution of the 
average equation 

du{t)/dt = v{u{t)). 
The average velocity v{u) ,u is defined by 

v{u) = I v{u;x)7r{dx) 



(i.e. by the average of the initial velocity v{u;x) over the stationary distribution 
Tr{B),B e £). 

The rate of convergence in (7) can be investigated in two directions: 
i) asymptotic analysis as e J, of the fluctuations 

C{t) = u'{t)-u{ty, (8) 



ii) asymptotic analysis of the average deterministic evolution 

= Eiifiu" {t))\u'' (0) = u, 33^(0) = x]. (9) 

The asymptotic analysis of fluctuations (8) leads to the diffusion approximation 
of the random evolution [9l [20] . 

The asymptotic analysis of the evolution (9) is realized in what follows by con- 
structing the asymptotic expansion in terms of the small parameter e (e J, 0) in the 
following form (r = t/e): 

CO 

^l{u,x) = Uo{t) + Y,^''[Uk{t) + Wk{r)]. (10) 

k=l 

The asymptotic expansion (10) contains two parts: 

i) the regular term U^{t) := Uo{t) + T.T=i^^Uk{t), 

ii) the singular term (boundary layer) W^{t) := X^^^i ^^^^^(t), r = t/e. 

In addition the 'regular degeneration' (see [TJ [22]) of the initial and 'boundary' 
condition 

Uo{0) = ip{u)l,Uk{0) +Wk{0) = 0,k > 1, 

W'{t) + U%£t) - ip{u) = 0, t < ^ ' 

has to be valid for all x € i?, n € M'^. 

Remark 1.1. The singular terms in (10) are determined by the boundary condition 
at infinity: 

Wk{+oo) = 0,k>l. 

Asymptotic expansions with 'boundary layers' were studied by many authors 
(see [U [22]). In particular, functionals of Markov and semi-Markov processes are 
investigated from this point of view in [ini UHl [2T] . 

In this work the asymptotic expansion (10) for the average semi-Markov random 
evolution (9) is constructed by using the solution of an integral Markov renewal 
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equation. The algorithm for the construction of expHcit regular and singular terms 
and boundary conditions is given in the following Theorem, which will be proved in 
some stages (see the following Lemmas). 
We use the following notations: let 

k 

LkU{t) := ^(-irV"(x)P[/(*^-")(t), (12) 

n=0 

where U{t) is any smooth function, U^^\t) := ^ ^jf' , P is defined by (3), Y{x) is 
defined by (6), 

mfc(x) 

We also set: 

oo 



QTy(r) := J F^{ds)PW{i 



^\r) := F^'^(r)V'=P^(u),^o'(^) := ^ Q^W-fe-.(r), 



k-l 



r=l 



oo , oo 
„k—l 



.^^—^F,{s)ds,Q^WiT) := J '-F,ids)Y'PW{T-s), 

T 

F^{t) :=l-F^{t),T = t/e. 

Theorem 1.2. Under the conditions of uniform ergodicity of the underlying semi- 
Markov process and the existence of a global solution in B{W^) of the system (5), the 
asymptotic expansion of the semi-Markov evolution 

mu,x) = E[ip{u'' {t))\u'' {Q) = u,a3(0) = x] 

has the form 

oo 

mu,x) = U'{t) + W%t) = Uo{t) + J2^'iUk{t) + Wkir)), 

k=l 

where 

Uo{t) = co{t)l. 
The function co{t) satisfies the equation 

.dco{t) dcoit) 
"^"^^^^ ar = '' 

or 

dco{t)/dt = Ycoit), 

where (correspondingly to (6)): 

Y(p{u) := v{u)(p' (u) , 
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v{u) := v{u; x)TT{dx) is the average of the initial velocity v{u; x) over the stationary 
distribution of the semi-Markov process. The initial condition is 

co(0) = ip{u). 

The regular terms are the following: 

Uk{t)=Ro (^^Hn{x)KUk-n{t)j +Ck{t), 



where, according to Mq = [Q + n] ^ — 11. 
The functions Ck{t) satisfy the equations 

Lick(t) = -n£fcCo(t) - ... - 



U£ick^i{t),k> 1 



where n£fc := Yln=i ^lJ-n{x)LnRo2,k^n + Tlfik+i{x)Lk+i,USlo := IILi = Li. 
The singular terms satisfy the Markov renewal equations (k > 1): 



F,{ds)PWk{T - s) - Wk{T) = ^Hr) - " V'i'(r), r > 



with 



i^^r) := I F,{ds)PWk{r-s), 



(P is given by (3)) and may he explicitly written in the form: 

Wi{t) = Ro[V'(t) +£.{t)PUi{Q) + f^{T - s)F,{ds)PUl,m, 



where Rq is the Markov renewal operator |19j . 
The initial conditions are given by: 

{I-U)[Uk{0) + Wkm=0, 



Cfc(O) = -UWkiO), 
■fc-1 „ 

/ 'n-{dx)uk-rix)Lk-rUriO)- 
, n ^ 



_r=0 

OO T 



r=l 



Yl / P(d^) / / -FAds)Y'{x)PWk-r{r - s)dT 







/m, 



where Vk{x) = (-l)*=[mfc(x) - 

Proof. The proof is a consequence of the Lemmas in sections 2-6. 
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Remark 1.3. For sufficient conditions for the assumptions to hold see, e.g. [4,10]. 
The equation for co{t) corresponds to the one given by the averaging theorem [9]. It 
states that the hmit of the semi-Markov evolution 

^l{u,x) =^ 

satisfies the equation 

Here ^tiu) is the deterministic evolution 

= ip{u{t)),u{0) = u. 

The average limit evolution u{t),t > is defined by a solution of the average equation 

du{t)/dt = v{u{t)). 

2 Markov renewal equation 

Lemma 2.1. The semi-Markov evolution ^f{u,x) satisfies the equation 



J F4ds)Yes{x)P^Us{u,x) - ^UU,X) 





oo 
r 

where r = t/e. 



oo 

■Yix) J F^{s)Yes{x)^iu)ds, (13) 



Proof. Using the first jump moment of the switching process 9x, we have: 
^Uu,x) = EuAipiu'{t));ex > t/e]+EuA^{u'{t)y,9x < t/e] = 

t/e 

= Fx{t/e)Yt{x)Pip{u) + J Fx{ds)Yes{x)P<^U,{u,x). 



So: 

^t{u,x) - J Fx{ds)Yes(x)P<^t-esiu,x)=Fx{T)Yt{x)Pip{u). 


Extending by the continuity, ^f_^g{u,x) = ip{u),t — es < 0, let us rewrite the 
latter equation in the form: 

oo 

mu,x)- J Fx{ds)YUx)P<^Us{u,x)=Fx{T)Yt{x)Pip{u)- 
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So, we have: 



<^liu,x) - J F^ids)YUx)P'^t-esiu,x) = F^{T)Yt{x)Pip{u)- 



oo 

-F^{s)N,s{x)Pv{u)\^ -eN{x) j F^{s)Y,s{xMu)ds. 

T 

This gives equation (13). □ 

3 Equations for the regular terms 

Lemma 3.1. The equation for the regular part of the asymptotics has the form: 



QU%t) 



^£^IXk{x)Lk 



.k=l 



W{t). 



(14) 



Proof. We use the equahty: 

aPh-l = {P-l) + {a- \)P + P{b - 1) + (a - l)P{h - 1), 

where a = V,,,(.x) = I + Y.V=i e%N\x\h = = Er=o(-l)'^'H^f ^(«' 

Let us rewrite (13) in the following way: 

oo / \ 

C / °° k \ 

{P-m{u,x)+ J F,{ds) \^^e'''^YHx)j X 
xP^t{u,x) + J F,{ds)pl^J2^-l)''e''-^l'\u,x)\+ J F,{ds) 

Q \A;=1 / Q \fe=l 

(oo ^ \ °? 

^(_l)fc£fc|_$«(„,^)j =eY{x) jF,{s)Y,s{x)P^{u)ds. 

Substituting (10) for the regular part, we have: 

°9 /oofc \ °9 /oo 

(P - I)U^t) = -J F,{ds) [^^e^'-Y\x)^ PU%t) - I F,{ds)P \Il(-^)'> 



/oo/j \ /oo \ 
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Gathering the terms with the same degree of e, we obtain: 



(p - i)u^{t) = 



oo 

k 



e 

k=l 



n n \n=l 





oo 

A.' \ /• k 

V(fc-n)(^-)p^£(n)(^) j - j {-\fF^{ds)PyU<^\t) 



(k — n)\n\ 





k=l 



To obtain (14) we should divide the last equality by mi{x). 
Then the lemma is proved. □ 

If we put into (14) the expansion U^{t) = Ylk'=o^^^k{t) and gather together the 
terms with the same degree of e, we obtain the following corollary. 

Corollary 3.2. The regular terms of the asymptotics satisfy the following system of 
equations: 

QUoit) = 0, 

QUk{t)=Zl=lfin{x)LnUk-n{t),k>l ^ ' 

The first regular term Uo{t) belongs to Nq, according to the first equation of the 
system (15). 
Hence: 

Uo{t) = co(t)l, 

where co{t) is a scalar function that does not depend on x. To obtain the equation 
for co{t) the solvability condition for the following equation is used: 

ULiCoit) = 0, 

which leads to the average equation 

Lico(t) = 0, LiU = ULiU. (16) 

Corollary 3.3. The function co(t) satisfies the equation with initial condition: 

*(-)^-^-«. 

co(0) = (p{u). 

Proof. The explicit form of Li may easily be found using (12): 

Lico(t) := '^(^)~^~ ~ ^^°^^\ '0(it) := Ilv{u,x) := J v{u,x)Tr{dx). 

E 

From this and (16) we obtain the equation in corollary 3.3. The initial condition 
follows from the formulae (11). 
The corollary is thus proved. □ 
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For Ui{t) we obtain: 

Ui{t) = RoLiUoit) + ci(t) = RoLMt) + ci{t). 
Using the solvability condition for the third equation of the system (15), we have: 

ULiRoLico{t) + Uf^2{x)L2Co{t) + Lici{t) = 0, 

or 

Lici(t) = -n£iCo(t), 

where U£,i := ULiRqLi + n/X2(x)L2. 
For Uh{t) we obtain by analogy: 

Uk{t) =Ro (^^tin{x)LnUk-n{t)^ + Ck{t), 

Lickit) = -USlkCoit) - ... - U2ick-i{t), 

where U£,k := Yln=i ^fJ-n{x)LnRo^k~n + n|Ufc+i(x)Lfe+i, n£o := IILi. 

The regular terms Uk{t),k > 1 contain two parts: one in the null-space Ck{t) and 
one in the space of values Rq: 

Uk{t) = Ckit)l + U^it), U^{t) e Rq. 

The scalar functions Ckit),k > 1 satisfy the same equations with the operator Li 
but with different right-hand side. Hence the unique solution can be defined by using 
the initial condition Cfe(O). Meanwhile the second part U^{t) is defined uniquely by 
the relation 

It is worth noticing that the regular part U^(t) in Rq is determined uniquely for 
t on the entire real line M = (— oo, +oo). 

4 Equations for the singular terms 

The equation for the singular term W{t)^t = tjeie > 0) is constructed in a very 
simple way, because the shift by —es may be transformed into the convolution 

oo 

jO^W'ir) = J F,ids)Y,,ix)PW%T - s) - W'{t) = eV.(r), (17) 



where sipeir) = eY{x) Fx{s)Yes{x)ip{u)ds. 
The algebraic identity 

VP-I = P-I+{V-I)P 
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provides the representation 

(Q - I)W'{t) + q,\W%T) = eMr), 

where 

(Q - I)W^{t) := J F^{ds)PW^{T - s) - W%t) 


is the renewal operator on the real line — oo < r < +00 and 

00 

QlW'ir) := J F^{ds)[Yes{x) - I]PW%t - s). 


Now the equations for the singular terms are constructed in the usual way: 
Lemma 4.1. The equations for the singular terms have the following form: 

{Q-I)Wl{T)=ijHT), 

(Q-/)l^fc(r) = V''(^)-V'o'W, 



(18) 



Proof. If we put the following expansion W'^{t) = X^fc^i ^^^'^ equation 

(17) we obtain: 



00 h 



k=l 



P 



Lfe=i 



T — S] 



k=l 



°° k-1 



i (k-i)! 



Pip{u)ds. 



So, we have: 



00 k—l 



e[Q - I]Wi{t) + ^e'[Q- /]T^,(r) + ^e'^Q^ 



k=2 



k=2 r=l 



■.Wk-r{r) = Y.e''F\T)N\x)Pip{ 



k=l 



and gathering the terms of the same degree of e, we obtain (18). 
The lemma is thus proved. □ 

Corollary 4.2. The singular terms of the asymptotics have the following form: 

H^i(t) =Ro[^i(r)-V!(r)], 
Wkir) = Ro[V''(r) - ^o^(t) - Vi'(r)], k>2. 



Here Rq is the Markov renewal operator [19j . 
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Proof. The extended Markov renewal equation (18) for the singular terms may 
be transformed into a standard form as follows 

r 

J F,{ds)PWkiT -s)- Wkir) = i^'ir) - V'S(r) - Vi (r), r > 



with 

oo 

^i{r) ■■= j F^{ds)PWk{T - s). 

T 

Following [9] we may find the solution of standard Markov renewal equation using 
the Markov renewal operator Rq. 
Hence the corollary is proved. □ 

Prom the corollary we have that the singular term can be defined after continua- 
tion to the negative real line for r < 0. The additional boundary condition 

Wk{+oo) = 

and the 'regular degeneration' of boundary conditions (11) provide the unique deter- 
mination of the singular term. 



5 Regularity of boundary conditions 

The initial extended Markov renewal equation (13) takes place under the continuously 
differentiable extension of the regular part U^{t) on the negative real line for t < 0. 
That is the concordance of the boundary conditions (11) have to be valid, or in other 
form we should have 

W%t) + U%et) + Uo{et) = 0, t < 0. (19) 
The representations (19) and (11) and the Taylor formula for r < 0: 

ifiu) = ^eT{u,x)\r<o = Uo{0) + ^s''^U^''\o) + eUi{0)+ 

k=l 

oo ^ oo 
k=l ' k=l 

give the boundary conditions for the singular terms in the following form 

Wkir) = Wk{Q) - ^?^fei(0), r < 0, fc > 1 (20) 

Tl. 

n=l 

and the additional initial condition 

Wjk(0) + C/fe(0) = 0,A;>l. (21) 
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The condition (20) may be used to construct a solution of the Markov renewal 
equation (18) for the singular terms. The boundary condition for singular terms 
Wfc(+oo) = 0, A; > 1 and the Markov renewal limit theorem [19] provide by a calcu- 
lation: 

UWkiO) G Nq 

and, as a result, we obtain an initial condition for the regular part in Nq 

Cfc(O) = -UWkiO). 

The last step to verify the regularity of boundary conditions (11) is to establish 
the following relations: 

[p-i]{Wk{o)+Ukm = o,k>i, 

which are, in fact, equivalent to (11). 

These are the regular and corresponding singular terms in the subspace of values 
Rq which compensate each other without any further assumption. A good formula- 
tion of the problem of asymptotic expansion leads to the regularity of the boundary 
conditions (11). 

Lemma 5.1. The regular degeneration equation has the form: 

{P - I)[W{0) + W%0)] =0. 
Proof. Let us consider the equation (18). For Wi{t) we have: 

oo 

F,{ds)PWi{T -s)- Wi{t) = J F,{ds)Y{x)PUo{0). 

T 

For r = we obtain: 



F,ids)PWi{0)-WiiO) 



+ J F,{ds)PiWi{-s)-Wi{0)) = J F,{ds)Y{x)PUo{0). 



,0 JO 

Using the equality (20) we have: 



oo oo 



iP-I)WiiO) = - j sF^{ds)PU'Q{id) + J sF^{ds)Y{x)PUo{0). (22) 


For the corresponding regular term, we get from (14) and (12): 

(P - /)[/i(0) = mi{x)PU(){0) - mi(x)V(x)PC/o(0). 

So, the following equality is true: 

(p-i) [Ui{o)+wim = o. 
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By induction, if we have: 

(P - /) [Un{0) + = 0, n = 1, . . . , fc, 

then for Uk+i{0) and Wk+i{0) we obtain: 



(23) 



F^{ds)PWk+i{r -s)- Wk+i{T) = j F^ids) ^ ^-_^V»(x)PC/o(0) 

T 

oo ^ 



n=l 



For r = we have: 



oo oo 

J F^{ds)PWk+i{0) - Wk+i{0) + J F^{ds)P{Wk+i{-s) - Wk+m) = 



oo oo , 

F,{dsf-\^+\x)PU^{<d) - j F,{ds) ^V"(x)PH^fe_„+i 



(-.). 





By the equality (20) we obtain: 

fc+i 



/ { \Tl c h-\-\ 

F.{ds)Pj2^-=^uti+im J F,ids)j^—^Y''+\x)PUo{0) 

n 71=1 n 



OO ^ 

I F,{ds)J2"^Y-i^)P 





fc-n+1 



n=l 



By induction, as soon as (21) and (23) are true, we may write: 

/ ' / \j2 /» /C-|-l 

P,(d.)P^ ^^i-n+i(0)+ y F,{ds)-^^—^Y>'+\x)PUoiO) 



Px(ds)5^^V»(x)P 



n=l 





fe-n+1 



-^.-n+l(0)- E ^^i-U(O) 



n=l 



(24) 



For the corresponding regular term, we have from (14) and (12): 

/ /» h-\-l. ^ 

^-(^^)^E^^fc-n+i(0)- / P,(d.)5;^V"(x)PC/,_„+i(0)- 





oo 



- f F^{ds)Y,-^Y-{x)p y: 

i n=l r-=l 



^1 



I k—n—r-\-\ 



(0). 
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It is easy to see that the fohowing equaUty is true: 

(p-/) [Uk+m+Wk+im = o. 

So, by induction the lemma is proved. □ 
Corollary 5.2. 

{I-P)[U'{0) + W%0)]=0, 

or, in other words, 

{I-U)[Uk{0) + Wkm = 0. 

The proof is obvious. 

So, we can see that in the space of values of the operator Q the regular and 
singular parts of the solution fulfil the initial conditions (11). 

At the same time, in the null-space of Q the initial conditions for the regular 
terms are determined by the initial conditions for the singular terms, so we have 

Corollary 5.3. 

Ck{0) = -UWk{0),k>l. 

Proof. We obtain obviously: n[Wjfc(0) + Uk{0)] = UWk{Q) + Ck{0) = 0. □ 

Corollary 5.4. The singular terms of the asymptotics have the following explicit 
form: 

Proof. Using formulae (20) and corollary 5.3 we easily obtain: 

[ F,{ds)PWk{T -s)= [ F,{ds)P[-Uk{0) - ^(r - s)"t/^i(0)] = 

k °° 

= -P,(r)PC/,(0) - /(r - .)"P..(d.)PC/£U0)- 
n=ii 

This proves the corollary. □ 

6 Initial conditions for the regular terms 

We are going to write down an algorithm for the construction of initial conditions 
(at t = 0) for the regular terms using the boundary conditions for the singular terms 
as r ^ oo (see Remark 1.1). For the first singular term Wi{t) we have the equation 
(see (18)): 



/ 



Q{ds)Wi{T -s)- Wiir) = pi'^(r)V(x)P(^(u), (25) 



16 



where F^^\t) = F,{s)ds. 

Separating the first integral into two parts, we obtain: 

T OO 

J Q{ds)Wi{T - s) - Wi{t) = F^^\t)Y{x)Pip{u) - J Q{ds)Wi{T - s). 

T 

According to the renewal theorem [19] we have for r — > oo: 

(OO OO 
j p{dx) j j F^{s)dsdTYix)P^iu)- 
T 

OO OO \ 

- J p{dx) j j Q{ds)Wi{T - s)dT \ /m, (26) 

T / 

where rh = J p{dx)mi{x). 

For T < we have from (20): 

Tyi(r) = VFi(0)-r[7^(0). (27) 

Substituting the correlation (27) into equation (26), we obtain: 

(OO OO 
j p{dx) j j F^{s)dsdTY{x)Pip{u)- 
r 

OO OO \ 

- J p{dx) J J Qids)[Wi{0) - (r - s)C/^(0)]dr j /m = 

Or / 

OO 

p{dx) [ F^^\s)dTY{x)P(p{u)- 



p{dx) j j F,j,{s)PWi{<d)dsdT + j p{dx) J J Q(ds)(r - s)f/^(0)dT | /m 

T Or 

pidx)^^Y{x)P^{n)- 
p{dx)miix)PWi{0) - j p{dx)^^^^^^PU[^{0)^ /m = 
p{dx)mi{x)p2{x)Li{x)ip{u) — / p{dx)mi{x){P — I)Wi{0)- 



p{dx)mi{x)Wi{0) I /fh 
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p{dx)mi{x)n2ix)Li{x)ip{u) - / p{dx)mi{x){P - I)Wi{0) ] /m-UWi{0) 



p{dx)mi{x)iX2{x)Li{x)ip{u) — j p{dx)mi{x){P — I)Wi{Qi) j /m + ci(0), 

(28) 

here p2{x) = 

We may rewrite (22) in the form: 

[P - /]VFi(0) = mi(x)[V(x)P(^(u) - PU'^i^d)] = Li{x)ip{u). 

If we put the last equaUty into (28), we have finally: 

p{dx)'mi{x)p2{x)Li{x)(f{u) + J p{dx)mi{x)Li{x)(f{u)^/m + ci{0), 
or 

ci(0) = nf7i(0) = j ■K{dx)vi{x)Li{x)ip{u)/m, 

where ^{dx) = p{dx)ini{x), i^i{x) = P2{x) - mi{x) = '"^^2^^^^/^'^^ • 

Remark 6.1. It is easily seen that vi{x) = 0, when Fx{t) is distributed exponentially. 
In this case, we obviously have: 

ci(o) = nc/i(o) = 0. 

Note, that ui{x) may be either positive or negative, see, e.g [9]. 

We shall describe the algorithm for computing the next terms of the asymptotics 
in the case of W2{t): 



Q{ds)W2{T-s)-W2{T) = F':' {t)Y\x)P^{u)- j -F^{ds)Y{x)PWi{T-s), (29) 



where F^^V) = sF^{s)ds. 

Separating the first integral, we obtain: 



oo 



Q{ds)W2{T - s) - W2{t) = F^^\t)Y\x)P^{u) - / ^F.^{ds)Y{x)PWi{T - s)- 



Qids)W2{T-s). 
According to the renewal theorem [TP] we have for r — > oo: 

/ oo oo 

= W2(oo) = I I p{dx) j j sF^{s)dsdTY^{x)Pip{u)- 

T 
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oo r 

J p{dx) J J ^F^{ds)Y{x)PWi{T - s)dT+ 



Lo 



oo 

+ J ^F^ids)Yix)PWi{T - s)dT 



p{dx) j j Q{ds)W2iT - s)dT I /m. (30) 

T 



Lo 



For r < we have from (20): 

W2{t) = W2{Q) - tU[{{)) - T^Ui;{0). (31) 
Substituting (31) into (30), we obtain, like in the case of Wi{t): 

(oo oo 
j p{dx) j j sF^{s)dsdTY^{x)P(p{u)- 
T 

OO r T oo 

- J p{dx) J J ^F^{ds)Y{x)PWi{T - s)dT + J ^F^{ds)Y{x)P {Wi{0)- 

T 

- (r-5)f/^(0)}dr]- 
p{dx) 1 1 Q{ds)[W2{0) - (r - s)U[{0) - (r - sfU(;{0)]dT J /m = 

Or / 

p{dx)mi{x)iJ,2{x)Li{x)Ui{0) + J p{dx)mi{x)ps{x)L2{x)UQ{0)— 
- J p{dx)mi{x){P - I)W2{0)- 

oo T \ 

- J p{dx) j j ^^ F^{ds)Y{x)PWx{T - s)dT \ /m + C2(0). (32) 







We obtain from (24) in case oi k = 1: 

[P - I]W2{Qi) = m2{x)Y'^{x)P^{u) - mi{x)PU[{Qi) + m2(a:)PC/^'(0)+ 

+mi{x)Y{x)PUi{Q) - m2{x)Y{x)PUQ{0) = m2{x)L2{x)Uo{0) - mi(x)Li(x)C/i(0). 
Substituting the last equality into (32), we finally get: 



C2(0) 



J Tr{dx)i^2{x)L2{x)Uo{0) + J 7r(dx)z/i(x)Li(x)C/i(0)- 



OO T 

J p{dx) J J ^F^{ds)Y{x)PWi{T - S)d7 







/m. 
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1 / \ / \ / \ 2mi(x)m2(x)—m3(x) 

where U2{x) = m2{x) - ^3(2;) = 31^1 (x) • 

For the next terms we have by analogy: 



Cfc(O) 



k-l 

/ TT{dx)uk-r{x)Lk^r{x)Ur{0)- 

r=0 



k-l , °? t; r- 

S 



r=l 



E / z^^^^) / / -^x(ds)V'-(x)PW^fc_,,(r - s)dT 







/m, 



where Uk{x) = (-l)''+^[/Ufc+i(x) - mk{x)]. 

Remark 6.2. The last term of this equality may be rewritten without the use of 
singular terms. This may be done, like in the work [T^, using the Laplace transform 
of the Wi{T). 

This finishes the proof of Theorem 1.2. □ 

7 Estimate of the remainder 

We suppose in addition to the previous assumptions that the function v{u;x) in (5), 
(6) satisfies the condition 

sup snY>\v{u;x)\ <Cji, (33) 

\u\<Rx€E 

where R > 0. 

Lemma 7.1. If solves 

h'^' ■.= [Q + eQiW = eij, (34) 
where ij: is given, such that \\ip\\ < C, \ \Q^^\\ < C, HQill 1^ C, then 

W\\< Cie. 
Proof. The solution of equation (34) is: 

We can make the following iteration: set 

^(0) = eV', 
Pfo)ll=^llV'll<eC, 

then 

<^>l^=eQ-'[i;-Qi^o^], 
as soon as Q^^ and Qi are bounded 

\\<l>y\<eC{C + C\\<^y\)<C{eC + {eCf). 
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By induction, we have: 

N 



k=l 

We may choose the parameter e small enough, so that eC < 1. Thus, for N 
we obtain: 

fC 

\m\<C- -<eCi. 

1 — eC 

The lemma is thus proved. □ 
Corollary 7.2. If solves 

L^$^ := [g + £Qi]$" = £^+V, G 
where Wi^W < C,\\Q-'^\\ < C,\\Qi\\ < C, then 

Proof. Let us suppose 

:= e^W. 

Then, we have from (35): 

So, we obtain an equation for $^: 

L^l*" = etp. 

By Lemma 7.1, we have 

ll^^ll < Cie, 

or, for $^: 

W\\<Cie^+\ 
Hence the corollary is proved. □ 

Let us consider the estimate of the remainder, written in the form: 

N 
k=l 

Theorem 7.3. Under the conditions (1) and (33) the following estimate for 
remainder in the expansion of Theorem 1.2 holds: 

W'^{t)\\ < C^e^+\ 

for some C. 
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Proof. To prove this Theorem we should show that ^^'^{t) satisfies the conditions 
of Corollary 7.2. 

Let us first consider U^^^{t) := U^{t) - Uo{t) - Y^k=i^^^k{t), that is the regular 
part of 

Prom the equation (13) we obtain: 

oo oo 

j F^{ds)Y,s{x)PU''''{t-es)-U''''{t)= J F,(ds)V,,(x)P[C/^'^(t-£s)-C/^'^(t)]+ 





oo 

+ 



oo 

—£ 





j F,{ds)Y,s{x)PU''''{t)-U''''{t) = QU''''{t)+ j F,{ds)[Y,s{x)-I]PU''''{t-ss)- 



oo oo 

J sF,{ds)Y,s{x)P{U''''{t)y+ J F,{ds)Yes{x)P[U''''{t-es)-U''''{t)+es{U''''{t)y] = 



oo 

= QC/^'^(i) - F,{s)[Y,s{x) - /]PC/^'^(t)|S° + eY{x) j F,{s)Y,s{x)PU''''{t)ds- 



oo oo 

-£ J sF,{ds)Y,s{x)P{U''''{t)y+ J F,{ds)Yes{x)P[U''''{t-es)-U''''{t)+ss{U''''{t)y] = 





= [Q + eQl]U''^{t), 

where 



oo oo 



QfC/^.^(i) := V(x) J F^{s)Yes{x)PU''^{t)ds - J sF^{ds)Yes{x)P{U''^ {t)y+ 







oo 

+ J F,{ds)Yes{x)P[U''''{t - es) - U^'^'it) + es{U'''' {t)y]/e, (36) 





and we have by conditions (1) and (33): 

oo 

IIQfll = l|V / F,{s)YesPU'^''it)ds- J sF,{ds)YUx)PiU''''{t)y+ 





+ j F,{ds)Y,s{x)P[U''''{t - es) - C/^'^(t) + es{U''''{t)y]/. 



oo oo 

< ||V||||?7^'^(0I| J e-ll^llF,(s)ds + ||(C/^'^(0)'|| J sF^id.-^-^' 



e\\ < 
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+ J F^{ds)e''^^^^U''^{t-es)-U''^{t) + ss{U''^{t)y\\/e < 



<Ci+C2 + C3 = C, 

as soon as the functions U^'^{t) are from the space of real- valued functions which 
are bounded with all their derivatives. 

The operator Q has bounded inverse operator Rq = [Q + 11]^^ — 11 in Rq (see 

On the other hand, we have from (13): 
oo r oo 

J F^{ds)Yes{x)PU''^{t-es)-U''''{t) = J F,{ds)Y,s{x)PU%t - es) - U'{t) 



N 



Q + ^eVfc(a;)LA 



k=l 



N 



k=l 



(ss) 



N+1 



(iV + 1)! 



V(^+I)(x) / F,{ds) / Ye{x)x 



xPU%{t-es)de 



N / k \ ■ 

k=l \ r=l / 



where the last equality follows from (15), the function being an integral of the form 
(36) and may thus be estimated in the same way as the operator Qf. 
So, we showed that the function C/^'^(t) satisfies the equation 



[Q + eQf]C/^'^(t) =e^+V, 

where the conditions of Corollary 7.2 are satisfied for Q,Q\,ip. 
So, we obtain in Rq: 

It is easy to see that equation (37) in Nq has the form: 
From (36) we have: 



(37) 

(38) 
(39) 



Qlc''^{t) = mi{x)[Y{xy'''{t)-{c''''{t)y]+eY''{x) I F^{s) I Y0ix)Pc'''' {t)deds 



eV(x) / sF^{ds) / Ve{x)P{c'^''{t))'de+ / F^{ds)Ves{x)P[U'''' {t - es)- 



-U'^^{t)+es{U'^^{t))']/e. 
We obtain (39) in the following form: 

[Qi+eQ|]c^'^(i) = e^V', 
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where Q^^ is a bounded integral operator, and ip are integrals of the form (36) 

and may thus be estimated in the same way as the operator Qf . 

So the conditions of Corollary 7.2 are satisfied for Qi, Q2, tp, and we have in Nq: 



\\c'^^{t)\\<Ce^. (40) 
Let us now consider W^'^{t) := W'^{t) — J2k=i ^^^k{T), that is the singular part 

of $^'^(t). 

Prom the equation (13) we have: 

00 T 

J F^{ds)Y,s{x)PW''''{T-s)-W''''{T) = J F^{ds)Y,six)PW''''{T-s)-W''''{T)+ 





00 T 

+ 

T 



J F,{ds)\,s{x)PW''''{T -s) = j F,{ds)PW''''{T -s)- W^^'^(r)+ 

T 

T 

+ J F,{ds)Y,s{x)PW'^''{T-s)+ J F.,{ds)[Yes{xyi]PW''''{T-s) = [Q(r)-/]Vr'^(r) 

r 

00 

-F^{s)Y,s{x)PW''''{r - s)|~ + sY{x) J F^{s)Y,s{x)PW'''' {r - s)ds- 

T 

T 

-F^{s)[Y,s{x) - ^PW^'^'ir - s)|5 + eV(x) J F^{s)Y,s{x)PW''^ {t - s)ds = 



= [Q(r) - /]H/^'^(r) + F,(r)Vi(a;)PM/^'^(0) - F,(r)[Vi(x) - I]PT^^'^(0)+ 
00 

+eY{x) J F^{s)Yesix)PW^^^{T - s)ds = [Q(r) - I]W'^^ {t) + F^{t)PW^^^ {0)+ 


00 

+eY{x) J F^{s)Y,six)PW''''iT - s)ds = ([Q(r) - /] + £Qi)W^^'^(t), 





where due to Lemma 5.1 



£QiVF^'^(t) := eY{x) J F^is)Y,s{x)PW''^ {t - s)ds + F:,{t)PU'''' (0), 


and we have by conditions (1), (33) and (38): 

00 

IIQill = livy" F,is)YUx)Pds\\ + ||F,(r)Pt/^'^(0)|| < 
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<||V|| J e"\\''\\F,{s)ds + \\U'''\0)\\<Ci + e"+'C2<C. 



The conditions of Chapter 1, sections 3,4 from [19] are fulfrhed for the operator 
Q(r). In fact, 



j j j TT{dx)F^{dt)P{x,dy) = l<oo. 



E E 

So, the operator Q(t) — / has an inverse operator which is bounded. 
On the other hand, we have: 

oo r oo 

J F,{ds)Yes{x)PW''^{T-s)-W''^iT) = J F,ids)Yesix)PW%T - s) - W%1 



LO 



(Q-/)+5^eM F,{dsf-YHx)P 
k=l i 



N 



.k=l 



F^ds) 



(A^ + 1)! 



Yeix)PW'^{T - s)de. 



As soon as the term \^J^ Fx{ds)Yss{x)PW'^{T — s) — W'^{t)\ satisfies equation 
(17), we obtain: 



F^{ds)Yes{x)PW''''{T -S)-W' 



oo 

^.^(r) = eY{x) j F^{s)YUxMu)d6 



N N 



N+U 



k=l 



k=l 



N 

Y^e^ [(Q-/)Ty,(r)+^o'(T)] + 0{e 



k=l 



where we used the equahties (18). The function cf) is an integral of the form (36) and 
may be estimated in the same way as the operator Q\. 

So, we showed that the function W^'^ {t) satisfies the equation 



.N+l, 



([Q(r)-/]+eQi)VF-'^^(r)=e 

where Q(r) — I, Qi and (j) satisfy the conditions of Corollary 7.2. 
So, we obtain: 

\\W'^^{T)\\<Ce^+'^. (41) 
For the function $^'^(t) we have from (38), (40) and (41): 



^"•^(t)|| < \\U'''\t)\\ + \\c^''\t)\\ + \\W^''\T)\ \ <Ce^"+^ + Ce^"+Ce''+^ = CV\ 
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Finally, if we consider 
then 

As a result, the following estimation holds: 
Thus theorem 7.3 is proved. □ 

Acknowledgements.Th.is work was supported by DFG projects 436 UKR 113/70/0- 
1 and 436 UKR 113/80/0-1, which is gratefully acknowledged. 

References 

[1] Griego R., Hersh R., Random evolutions, markov chains, and systems of partial 
differential equations, Proc. Nat. Acad. Sci. U.S.A. 62, 305-308 (1969). 

[2] Hersh R., Random evolutions: a survey of results and problems. Rocky Mountain 
J. Math. 4, 443-477 (1974). 

[3] Hersh R., The birth of random evolutions. Mathematical Intelligencer 25(1), 
53-60 (2003). 

[4] Hersh R., Pinsky M., Random, evolutions are asymptotically Gaussian, Comm. 
Pure Appl. Math. 25, 33-44 (1972). 

[5] Hillen T., Transport Equations and Chemosensitive Movement, Habilitation the- 
sis. University of Tiibingen, Tiibingen, Germany (2001). 

[6] Korolyuk V.S., Stochastic systems with averaging in the scheme of diffusion 
approximation, Ukrainian Math. Journ. 57, 9, 1235-1252 (2005). 

[7] Korolyuk V.S., Boundary layer in asymptotic analysis for random walks. Theory 
of Stochastic Processes 1^, 25-36 (1998). 

[8] Korolyuk V.S., Korolyuk V.V., Stochastic Models of Systems, Kluwer Acad. 
Publ. (1999), 250p. 

[9] Korolyuk V.S.. Limnios N., Stochastic Systems in Merging Phase Space, World 
Scientific Publishers (2005), 330p. 

[10] Korolyuk V.S., Penev LP., Turbin A.F., Asymptotic expansion for the distri- 
bution of absorption time of Markov chain. Cybernetics 4, 133-135 (1973). (in 
Russian) 

[11] Korolyuk V.S., Turbin A.F., Mathematical foundation of state lumping of large 
systems, Kluwer Acad. Publ. (1990), 280p. 

[12] Korolyuk V.S., Turbin A.F., Semi-Markov processes and applications, Naukova 
dumka, Kiev (1976), 181p. 



26 



[13] Kushner H.J., Approximation and Weak Convergence Methods for Random Pro- 
cesses, with Applications to Stochastic Systems Theory, MIT Press (1984), 269p. 

[14] Othmer H.G., Hillen T., The diffusion limit of transport equations IT. chemotaxis 
equations, Siam J. Appl. Math. 62(4), 1222-1250 (2002). 

[15] Papanicolaou G.C., Asymptotic analysis of transport processes. Bull. Amer. 
Math. Soc. 81, 330-392 (1975). 

[16] Papanicolaou G.C., Probabilistic problems and methods in singular perturba- 
tions. Rocky Mountain Journal of Math. 6, 653-673 (1976). 

[17] Pinsky M.A., Lectures on Random Evolutions, World Scientific (1991), 136p. 

[18] Samoilenko I.V. , Asymptotic expansion for the functional of markovian evolution 
in in the circuit of diffusion approximation, Journal of Applied Mathematics 
and Stochastic Analysis 3, 247-258 (2005). 

[19] Shurenkov V.M., Ergodic Markov processes, Nauka, Moskow (1989), 336p. (in 

Russian) 

[20] Skorokhod A.V., Hoppensteadt F.C., Salehi H. Random Perturbation Methods 
with Applications in Science and Engineering, Springer (2002), 488p. 

[21] Tajiev A., Asymptotic expansion for the distribution of absorption time of semi- 
Markov process, Ukrainian Math. Journ. 9, 422-426 (1978). (in Russian) 

[22] Vasiljeva A.B., Butuzov V.F., Asymptotic methods in the theory of singular 
perturbations, Vysshaja shkola, Moscow (1990), 208p. (in Russian) 

[23] Yin G.G., Zhang Q., Continuous-Time Markov Chains and Applications: a 
Singular Perturbation Approach, Springer (1998), 349p. 



27 



